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Can  you  use  robotics  and/or 
display  feedback  technology 
to  train  movement  skills? 


Haptic/Graphic 

Interaction 

with 

Simple  Objects 


Detecting  Hemispatial  Neglect 

in  stroke  survivors  (Assaf  Dvorkin) 


HEALTHY  PATIENT  WITH 

CONTROL  NEGLECT 

Reaction  time 


Correct  detection 


Interactive  technology  can 

•  Give  Precision  guidance 

•  Assist  as  needed;  wean 

•  Track  &  store  progress 

•  Rapidly  present  scenarios 

•  Render  “unreal”  forces 

•  Challenge  (train  robustness) 

•  Distort  reality  &  cause  adaptation 

•  Possibly  be  worn  and/or  taken  home 


Long  latencies  make  feedback  control 
impossible  for  most  everyday  movements 


REFLEX  TYPE: 

Movement 

Latencies 

Frequencies 

Musculoskeletal 

Impedances 

instantaneous 

00 

Spinal 

30-80  msec 
(Dewhurst,  1967) 

1.7  Hz 

(Hogan,  1990) 

Triggered 

80-120  msec 
(Crago,  et  al.,  1976) 

0.6  Hz 

(Hogan,  1990) 

Supraspinal  (long) 

120-180  msec 
(Schmidt,  1988) 

0.5  Hz 

(Hogan,  1990) 

Vision 

100  msec 
(Nashner  and 
Berthoz,  1978) 

0.6  Hz 

(Hogan,  1990) 

Vestibular 

102  msec 
(Melvill  Jones  and 
Watt,  1971) 

0.6  Hz 

(Hogan,  1990) 

Background  on  robotic  force  field  training 

adaptation  and  after-effects 

PROGRESSIVE  TRAI  Nl  NG: 


THEN  TURN  OFF 
THE  FORCES: 


"After-  effects” 


Shadmehr,  R  and  Mussa-lvaldi,  FA  (1994) 
Journal  of  Neuroscience  14:  3208-3224. 
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Dynamic  Model  of  the  Arm  &  controller 

Functional  form  assumptions 


I(x)x  +  G(x)  =  0  (uncontrolled) 
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Human-human  collaboration 
Custom-designed  force  fields 
iusiom-desiyned  Visual  distortions 
error  augmentation  (force  and  vision)  -  ‘ 
Obstacle  avoidance  (ehanyes  desired  iraj) 


EJenaory  erdaaover-ieach  visual  S/force 

, 


ifiidi 


Late 

Training 


ALTERI NG 
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HEALTHY 


Late 

Washout 


Mussa-I  valdi,  F.A.,  Patton,  J . 
L,  IEEE  International 
Conference  on  Robotics  and 
Automation,  2000,  San 
Francisco,  CA 


E.  Final 


A.  Unperturbed 


B.  Training  forces 


Patton,  J.  L.,  M.  E.  Phillips-Stoykov,  et  al.  (2006).  "Evaluation  of  robotic  training  forces  that  either  enhance 
or  reduce  error  in  chronic  hemiparetic  stroke  survivors."  Experimental  Brain  Research  168(3):  368-383. 
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Performance  Improvement  vs  Enhancement  of  error 
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Patton,  J.  L.,  M.  E.  Phillips- 
Stoykov,  et  al.  (2006).  "Evaluation 
of  robotic  training  forces  that 
either  enhance  or  reduce  error  in 
chronic  hemiparetic  stroke 
survivors."  Experimental  Brain 
Research  168(3):  368-383. 


A.  Unperturbed  baseline 


B.  Late  Machine  learning 


C.  Early  training 


D.  Late  training 


E.  after-effects 


F.  early  washout 


G.  late  washout 


(Subject  sfd54) 


Patton  Et  Al  (2006)  Custom-designed  haptic  training  for  restoring  reaching  ability  to  individuals  with  stroke.  JRRD  in  press 
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Error  reduces 
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Patton  Et  Al  (2005)  Custom-designed  haptic 
training  for  restoring  reaching  ability  to 
individuals  with  stroke.  JRRD  in  press 


Machine  learning 


Training  with  custom  forces 
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Error  Augmentation 


ERROR  AUGMENTATION  CANDIDATES 


GAIN 


OFFSET 


OFFSET 


Error  Augmentation  speeds  up 
&  increases  learning  in  healthy  individuals 
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Current  Work:  2  hands 


Therapist-Driven  Trajectories 
Patient-Driven  Trajectories 
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Free  exploration 
learning  with  error 
augmentation  via 
negative  damping 
enhances  learning 

(Felix  Huang) 


A,  Planar  manipulandum 
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C.  Performance 

Evaluation  Pha^e 


(A)  Regular  Evaluation 
(w/Loading) 
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(B)  Catch  Evaluation 
(w/o  Loading) 
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Initial  direction  error  with  desired  for  movement  direction  of  315degrees 
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Assessments 

Blinded  Rater 

Assessments  pre  and  post  each  tx. 

-  “Reach  and  retrieve”  (rag  on  a  stick) 

-  Functional  workspace  when  reaching 
towards  9  targets  on  periphery 

-  Wolf  Motor  Function  Test 

-  Box  and  Blocks 

-  Fugl-Meyer 


Figure  3:  Schematic  example  of  the  directions  and 
layers  of  the  functional  workspace  determined  in  the 
workspace  parts  of  the  experiment. 


Secondary  assessments 


How  much  time  (tx  vs.  setup)? 

how  long  did  it  take  to  achieve 
therapeutically  meaningful  effect? 

Which  treatment  engaged  /  frustrated 
patient 

Therapist  opinion 


EA  haptic  forces 

Force  F 


A 


V 


Figure  11:  The  double  exponential  function 
governing  the  error-augmentation  (dashed 
line  defined  in  Equation  1. 


Inclusion  Criteria 


Chronic  Stroke  (8+  mos  post)  (Changed  to 
6+  mos  in  NW IRB) 

Available  medical  records/radiographic  info 

Ischemic  infarct  in  MCA  (not  included  in  NW 
IRB) 

Primary  Motor  Cortex  Involvement  (not 
included  in  NW  IRB) 

Some  degree  of  shoulder  and  elbow  mvmt. 
AMFM  40-50  (Changed  to  25-50  in  NW  IRB) 


Exclusion  Criteria 


•  Bilateral  paresis 

•  Severe  sensory  deficits 

•  Severe  spasticity  (MAS  =  4) 

•  Severe  contracture  (added  to  NW IRB) 

•  Aphasia,  cognitive  impairment  or  affective  dysfunction  that  would 
influence  the  ability  to  perform  experiment 

•  Severe  concurrent  medical  problems 

•  Diffuse/multiple  lesion  sites  or  multiple  stroke  events 

•  Hemispatial  neglect/inattention  or  field  cut  that  would  influence  the 
ability  to  perform  experiment 

•  Ataxia  (added  in  NW  IRB) 

•  Significant  pain  (greater  than  5/10)  in  UE  (added  in  NW  IRB) 

•  Botox  injection  in  previous  3  months  (added  in  NW  IRB) 

•  Participation  in  other  UE  research  projects  (added  in  NW  IRB) 


Statistics 


Randomized  Mixed  effects  model 

-Trend  affecting  the  hypothesis  on  treatment 
type? 

-  Period-by  treatment  interaction 

-  Carry  over  effect 

-  Patient-by-treatment  interaction 

Bayesian? 

-  Early  results 

-  Alternative  to  testing 


R1 :  AIM  1 ,  Experiment  1.1 


Therapist-Driven  Trajectories 
17  subjects,  random  order  of  groups 
4  weeks  of  tx,  1  treatment  per  week 
(45  min) 

4  groups 

-  EA  with  visual  distortion 

-  EA  with  haptic  forces 

-  EA  with  visual  distortion  and  haptics 

-  No  EA 
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Figure  11:  The  double  exponential 
function  governing  the  error- 
augmentation  (dashed  line  defined  in 
Equation  1. 


